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DESCRIPTION 

PICTURE CODING METHOD 

Technical Field 

5 The present invention relates to a picture coding method for 

coding a picture. 

Background Art 

Recently, with an arrival of the age of multimedia which 

10 handles integrally audio, video and pixel values of others, existing 
information media, i.e., newspapers, journals, TVs, radios and 
telephones and other means through which information is 
conveyed to people, has come under the scope of multimedia. 

Generally speaking, multimedia refers to a representation in 

15 which not only characters but also graphics, audio and especially 
pictures and the like are related to each other. However, in order 
to include the aforementioned existing information media in the 
scope of multimedia, it appears as a prerequisite to represent such 
information in digital form. 

20 However, when calculating the amount of information 

contained in each of the aforementioned information media as the 
amount of digital information, the information amount per 
character requires 1 — 2 bytes whereas the audio requires more 
than 64 Kbits (telephone quality) per second and when it comes to 

25 the moving picture, it requires more than lOOMbits (present 
television reception quality) per second. Therefore, it is not 
realistic to handle the vast information directly in digital form via 
the information media mentioned above. For example, a 
videophone has already been put into practical use via Integrated 

30 Services Digital Network (ISDN) with a transmission rate of 64 
Kbit/s — 1.5 Mbit/s, however, it is impossible to transmit video 
captured on the TV screen or shot by a TV camera. 
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This therefore requires information compression techniques, 
and for instance, in the case of the videophone, video compression 
techniques compliant with H.261 and H.263 standards 
internationally standardized by International Telecommunication 
5 Union-Telecommunication Standardization Sector ( ITU-T) are 
employed. According to the information compression techniques 
compliant with the MPEG-1 standard, picture information as well as 
audio information can be stored in an ordinary music CD (Compact 
Disc). 

10 The Moving Picture Experts Group (MPEG) is an international 

standard for a compression of moving picture signals and MPEG-1 
is a standard that compresses video signals down to 1.5 Mbit/s, 
namely, to compress the information included in TV signals 
approximately down to a hundredth. The quality targeted in the 

15 MPEG-1 standard was the medium quality so as to realize a 
transmission rate primarily of about 1.5 Mbit/s, therefore, MPEG-2, 
standardized with the view to meet the requirements of 
high-quality picture realizes a TV broadcast quality for transmitting 
moving picture signals with a transmission rate of 2—15 Mbit/s. 

20 In the present circumstances, a working group (ISO/IEC 
JTC1/SC29/WG11) previously in the charge of the standardization 
of the MPEG-1 and the MPEG-2 has standardized MPEG-4 which 
achieves a compression rate superior to the one achieved by the 
MPEG-1 and the MPEG-2, allows coding/decoding operations on a 

25 per-object basis and realizes a new function required by the era of 
multi media. At first, in the process of the standardization of the 
MPEG-4, the standardization of a coding method for a low bit rate 
was aimed, however, the aim is presently extended to a more 
versatile coding including a coding of moving pictures at a high bit 

30 rate and a coding of interlace pictures. Moreover, a 
standardization of MPEG-4 AVC and ITU H.264 is in process as a 
next generation coding method with a higher compression rate, 
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jointly worked by the ITU-T and the ISO/IEC. The next generation 
coding method is published under the name of Committee Draft 
(CD) as of August 2002. 

In coding of a moving picture, compression of information 
5 volume is usually performed by eliminating redundancy both in 
spatial and temporal directions. Therefore, inter-picture 
prediction coding, which aims at reducing the temporal redundancy, 
estimates a motion and generates a predictive picture on a 
block-by-block basis with reference to forward and backward 

10 pictures, and then codes a differential value between the obtained 
predictive picture and a current picture to be coded. Here, 
"picture" is a term to represent a single screen and it represents a 
frame when used for a progressive picture whereas it represents a 
frame or a field when used for an interlaced picture. The 

15 interlaced picture here is a picture in which a single frame consists 
of two fields having different time. For coding and decoding an 
interlaced picture, three ways are possible: handling a single frame 
either as a frame, as two fields or as a frame structure or a field 
structure depending on a block in the frame. 

20 A picture to which intra-picture prediction coding is 

performed without reference pictures is called I-picture. A picture 
to which inter-picture prediction coding is performed with 
reference to a single picture is called P-picture. A picture to which 
inter-picture prediction coding is performed by referring 

25 simultaneously to two pictures is called B-picture. Two pictures 
whose display time is either forward or backward to that of a 
current picture to be coded can be selected arbitrarily as reference 
for coding B-picture. The reference pictures can be specified for 
each block which is a basic unit for coding and decoding, but they 

30 can be classified as the first reference picture for a reference 
picture that is described first in a coded bit stream and a picture 
that is described later as the second reference picture. However, 



the reference pictures need to be already coded or decoded as a 
condition to code or decode these I, P and B pictures. 

A motion compensation inter-picture prediction coding is 
employed for coding P-pictures or B-pictures. The motion 
5 compensation inter-picture prediction coding is a coding method 
applying motion compensation to inter-picture prediction coding. 
The motion compensation is not a method to simply predict 
motions using pixels in the reference pictures but to estimate a 
motion (to be referred to as "motion vector" hereinafter) at each 

10 part within a picture and improve prediction accuracy by 
performing prediction that takes the motion vector into 
consideration as well as to reduce the data amount. For example, 
the amount of data is reduced by estimating the motion vector for 
a current picture to be coded and coding prediction error between 

15 a predictive value, which is obtained after being shifted for the 
amount equivalent to the motion vector, and the current picture. 
In the case of using this method, information on motion vectors is 
required at the time of decoding, therefore, the motion vectors are 
coded and then recorded or transmitted. 

20 A motion vector is estimated on a block-by-block basis. 

More precisely, a motion vector is estimated by fixing a block in the 
current picture, then, shifting a block in the reference picture 
within a range of search, and finding out a location of the reference 
block that resembles a basic block. 

25 Fig. 1 is a block diagram showing the structure of the 

conventional picture coding apparatus. 

A picture coding apparatus 900 outputs a coded image signal 
(to be referred to as "bit stream") Str9 which is a bit stream 
obtained by coding an image signal Vin on a picture-by-picture 

30 basis, and includes a motion estimation unit 903, a motion 
compensation unit 905, a subtractor 906, an orthogonal 
transformation unit 907, a quantization unit 908, an inverse 
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quantization unit 910, an inverse orthogonal transformation unit 
911, an adder 912, a picture memory 904, a switch 913, a variable 
length coding unit 909 and an access point determination unit 902. 
Each component such as the motion estimation unit 903 executes 
5 the following processing per block or per macroblock that 
constitutes a picture. 

The subtractor 906 calculates a differential value between 
the image signal Vin and a predictive image Pre and outputs the 
differential value to the orthogonal transformation unit 907. The 

10 orthogonal transformation unit 907 transforms the differential 
value into frequency coefficients and outputs them to the 
quantization unit 908. The quantization unit 908 quantizes the 
frequency coefficients and outputs the quantized values to the 
variable length coding unit 909. The inverse quantization unit 910 

15 restores the frequency coefficients by inversely quantizes the 
quantized values and outputs the frequency coefficients to the 
inverse orthogonal transformation unit 911. 

The inverse orthogonal transformation unit 911 performs 
inverse frequency transformation on the frequency coefficients 

20 outputted from the inverse quantization unit 910 into pixel 
differential values and outputs them to the adder 912. The adder 
912 adds the pixel differential values outputted from the inverse 
orthogonal transformation unit 911 and the predictive image Pre 
outputted from the motion compensation unit 905, and generates 

25 a decoded image. The switch 913 connects the adder 912 and the 
picture memory 904 so that the picture memory 904 stores the 
decoded image generated by the adder 912. The decoded image 
stored in the picture memory is simply referred to as "picture" 
hereinafter. 

30 The motion estimation unit 903 refers to the picture stored 

in the picture memory 904 as a reference picture and specifies an 
image area that resembles the image signal Vin the most among 
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the reference pictures. Then, the motion estimation unit 903 
estimates a motion vector MV indicating a position of the image 
area. 

The motion estimation unit 903 also identifies a reference 
5 picture that resembles the image signal Vin out of the plural 
reference pictures using identification numbers (relative index Idx) 
for identifying the reference picture. 

The motion compensation unit 905 extracts an image area 
that is the most applicable to the predictive image Pre from among 
10 the pictures stored in the picture memory 904 using the motion 
vector MV and the relative index Idx. The motion compensation 
unit 905 then generates a predictive image Pre from the extracted 
image area. 

The access point determination unit 902 instructs the 
15 motion estimation unit 903 and the motion compensation unit 905 
to code (intra-picture code) per predetermined unit (random 
access unit) a predetermined picture as a special picture. The 
special picture here means a picture from which the decoding can 
be started in the stream Str 9. Furthermore, the access point 
20 determination unit 902 outputs an access point identifier rapp 
indicating that a picture is the special picture to the variable length 
coding unit 909. 

The variable length coding unit 909 codes a parameter set 
PS obtained from outside resources, the motion vector MV, the 
25 quantized values, the relative index Inx and the access point 
identifier rapp, generates a stream Str9 in which the coded 
parameter set is placed only at the head side, and outputs the 
stream Str9. 

Fig. 2 is a structural diagram showing the structure of the 
30 stream Str9 outputted by the conventional picture coding 
apparatus 900. 

The stream Str9 includes sequentially from the head a 
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synchronous signal sync, a parameter set PS, plural random access 
units RAU9. Such stream Str9 complies with the JVT 
(H.264/MPEG-4 AVC) which is presently in process of 
standardization, jointly worked by the ITU-T and the ISO/IEC. 
5 The parameter set PS is common data equivalent to a header 

and includes a picture parameter set PPS is equivalent to a header 
of the picture, a sequence parameter set SPS equivalent to a 
header of a unit with a level superior to a random access unit RAU9. 
The sequence parameter set SPS includes a maximum possible 

10 number of reference pictures, a picture size, or the like, whereas 
the picture parameter set PPS includes a type of variable length 
coding (a switching between Huffman coding and arithmetic 
coding), an initial value in the quantization step, the number of 
reference pictures, or the like. 

15 The random access unit RAU9 includes sequentially from the 

head a synchronous signal sync and a plurality of coded pictures 
pic. The random access unit RAU9 as such is a single unit 
including the plural pictures in the stream Str9 and includes the 
special picture as mentioned above which can be decoded without 

20 depending on other pictures. Namely, the random access unit 
RAU9 is obtained by dividing the stream Str9 into a group of plural 
pictures including a special picture. 

The picture pic includes sequentially from the head a 
synchronous signal sync and a parameter set identifier PSID and 

25 plural pieces of pixel data pix. 

The parameter set identifier PSID indicates the sequence 
parameter set SPS and the picture parameter set PPS, which are 
included in the parameter set PS, to be referred to by the picture 
pic. 

30 The synchronous signal sync included in the head of the 

stream Str9, in the head of the random access unit RAU9 and in the 
head of the picture pic indicates respectively a section 
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distinguishing the units such as the stream Str9, the random 
access unit RAU9 and the picture pic. 

Namely, in the picture coding method in which the 
conventional picture coding apparatus 900 generates a stream 
5 Str9 by coding the image signal Vin, a stream Str9 is generated in 
such a way that the parameter set PS is coded together and then 
placed at the head side of the stream Str9, whereas plural random 
access units RAU9, each of which does not include a picture 
parameter set PPS and a sequence parameter set SPS, follows the 
10 parameter set PS. 

When decoding such stream Str9, the picture decoding 
apparatus refers to the sequence parameter set SPS and the 
picture parameter set PPS included in the parameter set PS 
indicated by the parameter set identifier PSID in the picture pic so 
15 as to decode the picture pic. 

A conventional stream according to MPEG-2 has a structure 
different from the stream Str9. 

Fig. 3 is a structural diagram showing the structure of the 
conventional stream according to the MPEG-2. 
20 A stream Str8 according to the MPEG-2 includes sequentially 

from the head a synchronous signal sync, a header hed that is 
common data in the stream Str8 and a plurality of groups of 
pictures GOP. 

The group of picture GOP includes sequentially from the 
25 head a synchronous signal sync, a header hed that is common data 
for the group of pictures GOP and plural coded pictures pic. 

The group of picture GOP as such is a basic unit for coding 
and is used for editing a moving picture and performing random 
access. The picture pic included in the group of picture GOP is 
30 either I-picture, P-picture or B-picture. 

The picture pic includes sequentially from the head a 
synchronous signal sync, a header that is data common to the 
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pictures pic and plural pieces of pixel data pix. 

Namely, in the picture coding method according to the 
MPEG-2 for generating a stream Str8 by coding the conventional 
image signal Vin, a stream Str8 is generated in such a way that the 
5 header hed necessary for decoding the picture pic is included 
respectively in the heads of the stream Str8, each group of picture 
GOP and each picture pic. 

However, a problem is that the picture decoding apparatus 
cannot decode from a random access point that is a head of the 

10 random access unit RAU9 in the stream Str9 (i.e. random access) 
in an attempt to start performing random access, for example, in 
the case where the parameter set PS cannot be obtained since the 
stream Str9 is read out from the middle, as the parameter set PS is 
placed in one place at the head side of the stream Str9 according to 

15 the conventional picture coding method as described above, 
employed by the picture coding apparatus 900. Namely, the 
picture decoding apparatus cannot decode the picture pic properly 
because the corresponding picture parameter set PPS and 
sequence parameter set SPS are not found. 

20 More precisely, the stream Str9 cannot be decoded from the 

middle when the picture decoding apparatus has read in the stream 
Str9 from the middle under the circumstance where the stream is 
incessantly transmitted as in a case of broadcasting or delivery. 
In the case where the stream Str9 is recorded on a recording 

25 medium such as a tape or a disk, the picture decoding apparatus 
firstly has to read the parameter set PS placed in the head of the 
stream Str9 on the recording medium and then start reading the 
stream Str9 from the random access point in the attempt to start 
performing random access for the stream Str9. That is to say that 

30 the picture decoding apparatus has to shift the position of reading 
the data from the head of the stream Str9 to the random access 
point, and thereby, a prompt random access cannot be operated 
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since the shifting time becomes a waiting time for the random 
access. 

In the case where the recording medium is a tape, it is 
apparent that the waiting time is very long, and even if the disk is 
5 capable of high-speed reading, the waiting time may be prolonged 
to several seconds, which cannot be ignored. 

The picture decoding apparatus can perform random access 
for each group of picture GOP on the stream Str8 generated using 
the picture coding method according to the MPEG-2 by using the 
10 header hed in the group of picture GOP and the header hed in each 
picture pic. 

With the use of the picture coding method for generating 
such stream Str8, however, the compression rate of the stream 
Str8 is low since each of the pictures pic included in the group of 
15 picture GOP has a header hed and many of such headers hed have 
the same value as other headers hed. That is to say, the picture 
coding method for generating a stream Str8 allows a generation of 
a stream Str8 to which random access can be performed, on one 
hand, however, decreases the coding efficiency on the other. 

20 

Disclosure of Invention 

The present invention is therefore conceived in view of the 
above circumstances, and an object of the present invention is to 
provide the picture coding method for coding a picture so that a 

25 prompt random access can be operated without reducing the 
coding efficiency. 

In order to achieve the above object, the picture coding 
method according to the present invention for coding a picture 
signal on a picture-by-picture basis so as to generate a bit stream 

30 comprises: a coding step of coding a parameter set to be used for 
decoding all pictures included in an access unit made up of a 
plurality of pictures; and a parameter set placement step of placing, 
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in each access unit in the bit stream, the parameter set coded in 
the coding step. 

Thus, even in the case of obtaining such bit stream in the 
middle of the stream, the picture decoding apparatus can decode 
5 properly the pictures included in the access unit using the 
parameter set included in the obtained first access unit. As a 
result, the bit stream can be decoded properly starting from the 
access unit. Such bit stream is recorded in a recording medium, 
therefore, even in the case of performing random access on the bit 

10 stream, the picture decoding apparatus can start random access 
promptly, without shifting the position of reading out the data, 
from the head of the bit stream to the starting position of the 
random access, unlike the conventional example. Moreover, the 
redundancy of the bit stream can be reduced and the decrease in 

15 the coding efficiency can be prevented since the information used 
for decoding pictures is not placed for each picture in the bit 
stream. 

The picture coding method may further comprise a structure 
identification information generation step of generating structure 
20 identification information indicating a placement of the parameter 
set. 

Thus, the placement of the parameter set is indicated in the 

structure identification information. The picture decoding 

apparatus can therefore execute random access with a recognition 
25 that a precise and prompt random access can be performed for the 

bit stream on the access basis, by referring to the structure 

identification information. 

The parameter set includes a plurality of the picture 

parameter sets, and in the parameter set placement step, a picture 
30 parameter set for a picture is placed immediately before the 

picture in the access unit in the bit stream, except for a picture 

parameter set that is already placed. 
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Thus, the coded picture parameter set is placed immediately 
before the corresponding picture so that each picture parameter 
set can be coded and sequentially placed, which does not require 
the storage of the coded picture parameter sets. Therefore, the 
5 picture coding apparatus can be structured easily. 

In the coding step, either any or all of the picture parameter 
sets are coded for plural times, and a plurality of same coded 
picture parameter sets are generated, and in the parameter set 
placement step, the plurality of same picture parameter sets coded 

10 in the coding step are placed in the same access unit. 

Thus, a plurality of the same picture parameters are 
included in the access unit, therefore, it is possible to decode the 
bit stream thus coded, while preventing the occurrence of errors. 
The picture coding apparatus according to the present 

15 invention codes a picture signal on a picture-by-picture basis and 
generating a bit stream and comprises: a coding step of coding a 
parameter set to be used for decoding all pictures included in an 
access unit, except for a picture which refers to a picture in another 
access unit and is not displayed when random access is performed, 

20 the access unit being made up of a plurality of pictures; and a 
parameter set placement step of placing, in each access unit in the 
bit stream, the parameter set coded in the coding step. 

Thus, the parameter set is included in the bit stream for each 
access unit. Therefore, even in the case of obtaining such bit 

25 stream in the middle of the stream, the picture decoding apparatus 
can decode a current picture to be displayed included in the access 
unit using the parameter set included in the first access unit 
obtained. Consequently, the bit stream can be decoded starting 
from the access unit. Such bit stream is recorded in a recording 

30 medium. Therefore, even in the case of performing random 
access on the bit stream, the picture decoding apparatus can start 
random access promptly, without shifting the position of reading 
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out the data, from the head of the bit stream to the starting 
position of the random access, unlike the conventional case. 
Moreover, the redundancy of the bit stream can be reduced and the 
decrease in the coding efficiency can be prevented since the 
5 information used for decoding pictures is not placed for each 
picture in the bit stream. 

The present invention can be realized also as a picture 
coding apparatus or a program which uses the picture coding 
method as described above, or even as a bit stream generated 
10 using the picture coding method. 

Brief Description of Drawings 

Fig. 1 is a block diagram showing a structure of the 
conventional picture coding apparatus. 
15 Fig. 2 is a structural diagram showing a structure of the 

stream outputted by the conventional picture coding apparatus. 

Fig. 3 is a structural diagram showing a structure of the 
stream according to the MPEG-2. 

Fig. 4 is a block diagram showing a structure of the picture 
20 coding apparatus according to the first embodiment of the present 
invention. 

Fig. 5 is a structural diagram showing the structure of the 
coded image signal outputted by the picture coding apparatus 
according to the first embodiment of the present invention. 

25 Fig. 6 is a flowchart showing the picture coding method 

according to the first embodiment of the present invention. 

Fig. 7 is an illustration for describing the information 
outputted from the picture coding apparatus according to the first 
embodiment of the present invention. 

30 Fig. 8 is a structural diagram showing a structure of the 

stream Str that includes structure identification information 
according to the first embodiment of the present invention. 
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Fig. 9 is a structural diagram showing a structure of the 
stream outputted by the picture coding apparatus according to a 
first variation described in the first embodiment of the present 
invention. 

5 Fig. 10 is a flowchart showing an operation of the picture 

coding apparatus according to the first variation described in the 
first embodiment of the present invention. 

Fig. 11 is a structural diagram showing a structure of the 
stream outputted by the picture coding apparatus according to a 
10 second variation described in the first embodiment of the present 
invention. 

Fig. 12 is a flowchart showing an operation of the picture 
coding apparatus according to the second variation described in 
the first embodiment. 
15 Fig. 13 is a structural diagram showing a structure of the 

stream outputted by the picture coding apparatus according to a 
third variation of the first embodiment. 

Fig. 14A, 14B and 14C are illustrations of a recording 
medium on which a program for realizing the picture coding 
20 method according to the first embodiment of the present invention 
in a computer system is recorded, according to the second 
embodiment of the present invention. 

Fig. 15 is a block diagram showing a whole structure of a 
content supply system for realizing a content distribution service 
25 according to the third embodiment of the present invention; 

Fig. 16 is a diagram showing a cell phone according to the 
third embodiment of the present invention using the picture coding 
method described in the first embodiment. 

Fig. 17 is a block diagram showing the internal structure of 
30 the cell phone according to the third embodiment of the present 
invention. 

Fig. 18 is a structural diagram showing the structure of the 
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digital broadcasting system according to the third embodiment of 
the present invention. 

Best Mode for Carrying Out the Invention 

5 The following describes the embodiments of the present 

invention with reference to the figures. 

(First Embodiment) 

Fig. 4 is a block diagram showing a structure of the picture 
10 coding apparatus according to the first embodiment of the present 
invention. 

The picture coding apparatus 100 according to the present 
embodiment codes a picture so that a prompt random access can 
be operated without reducing the coding efficiency. More 

15 precisely, the picture coding apparatus 100 codes an image signal 
Vin on a picture-by-picture basis and outputs a stream Str. 

The picture coding apparatus 100 includes a motion 
estimation unit 103, a motion compensation unit 105, a subtractor 
106, an orthogonal transformation unit 107, a quantization unit 

20 108, an inverse quantization unit 110, an inverse orthogonal 
transformation unit 111, an adder 112, a picture memory 104, a 
switch 113, a variable length coding unit 109, an access point 
determination unit 102 and a PS memory 101. Each of the 
components such as the motion estimation unit 103 executes the 

25 following processing per block or per macroblock that constitutes a 
picture. 

The subtractor 106 obtains an image signal Vin, and also, a 
predictive image Pre from the motion compensation unit 105, and 
calculates a differential between the image signal Vin and the 
30 predictive image Pre. The subtractor 106 then outputs the 
differential value to the orthogonal transformation unit 107. 

The orthogonal transformation unit 107 transforms the 
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differential value into frequency coefficients and outputs them to 
the quantization unit 108. 

The quantization unit 108 quantizes the frequency 
coefficients obtained from the orthogonal transformation unit 107, 
5 and outputs the quantized values to the variable length coding unit 
109. 

The inverse quantization unit 110 restores the quantized 
values obtained from the quantization unit 108 into the frequency 
coefficients by means of inverse quantization, and outputs them to 

10 the inverse orthogonal transformation unit 111. 

The inverse orthogonal transformation unit 111 performs 
inverse frequency transformation on the frequency coefficients 
outputted from the inverse quantization unit 110 in order to 
transform them into pixel differential values, and outputs them to 

15 the adder 112. 

The adder 112 adds the pixel differential values outputted 
from the inverse transformation unit 111 and the predictive image 
Pre outputted from the motion compensation unit 105, so as to 
generate a decoded image. 

20 In the case where an instruction to store the decoded image 

generated by the adder 112 is received, the switch 113 connects 
the adder 112 and the picture memory 104, and allows the decoded 
image generated by the adder 112 to be stored in a picture memory. 
The decoded image stored in the picture memory is simply referred 

25 to as "picture". 

The motion estimation unit 103 obtains the image signal Vin 
on a macroblock-by-macroblock basis. The motion estimation 
unit 103, having obtained the image signal Vin, refers to the 
picture stored in the picture memory 104 as a reference picture, 

30 and specifies a picture area that resembles the obtained image 
signal Vin the most within the reference picture. The motion 
estimation unit 103 then estimates a motion vector MV indicating a 
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location of the image area. 

The motion estimation unit 103 estimates such motion 
vector MV in units of blocks, each being obtained by further 
dividing a macroblock. The motion estimation unit 103, then, by 
5 using identification numbers (relative index Idx) for identifying the 
reference pictures, identifies the reference picture that has been 
referred to among plural reference picture candidates, based on 
the picture numbers assigned to each of the pictures stored in the 
picture memory 104. 

10 The motion compensation unit 105 extracts an image area 

that is the most applicable for the predictive image Pre from among 
the pictures (decoded images) stored in the picture memory 104, 
using the motion vector MV estimated in the above processing as 
well as the relative index Idx. The motion compensation unit 105 

15 then generates a predictive image Pre using the extracted image 
area. 

The access point determination unit 102 instructs the 
motion estimation unit 103 and the motion compensation unit 105 
to code (intra-picture code) a predetermined picture as a special 

20 picture per predetermined unit (i.e. random access unit). The 
access point determination unit 102 further outputs an access 
point identifier rapp indicating that a picture is the special picture 
to the variable length coding unit 109. 

The PS memory 101 obtains the parameter set PS and 

25 temporarily stores it. The PS memory 101 then outputs, based on 
the instruction from the access point determination unit 102, a 
picture parameter set and a sequence parameter set of the picture 
indicated in the instruction from the temporarily stored parameter 
sets PS to the variable length coding unit 109. 

30 The variable length coding unit 109 codes the parameter set 

PS obtained from outside resources, the motion vector MV, the 
quantized values, the relative index Idx and the access point 
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identifier rapp. The variable length coding unit 109 then 
generates a stream Str by arranging for each random access unit 
the sequence parameter set as well as the sequence parameter set 
included in the coded parameter set PS, and outputs the stream 
5 Str. 

Fig. 5 is a structural diagram showing a structure of the 
stream Str outputted by the picture coding apparatus 100 
according to the present embodiment. 

The stream Str includes sequentially from the head a 
10 synchronous signal sync, a parameter set PS and plural random 
access units RAU. 

The parameter set PS includes plural sequence parameter 
sets SPS and plural picture parameter sets PPS. 

The random access unit RAU includes sequentially from the 
15 head a synchronous signal sync, a single sequence parameter set 
SPS, plural picture parameter sets PPS and plural coded pictures 
pic. Namely, such random access unit RAU includes all the 
sequence parameter sets SPS and the picture parameter sets PPS 
necessary for decoding all the pictures pic included there. Each of 
20 the picture parameter set PPS has a different value and any one of 
the picture parameter sets PPS is referred to by plural pictures pic 
and used for decoding the pictures. 

The picture pic includes sequentially from the head a 
synchronous signal sync, a parameter set identifier PSID and pixel 
25 data pix that is a codeword for pixels of the picture. 

The parameter set identifier PSID identifies the parameter 
sets SPS and PPS to be referred to by the picture from among the 
parameter sets SPS and PPS included in the random access unit 
RAU. 

30 Fig. 6 is a flowchart showing a picture coding method of the 

picture coding apparatus 100 according to the present 
embodiment. 
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The picture coding apparatus 100 firstly judges whether or 
not a current picture to be coded is a random access point, namely, 
the first picture in the random access unit RAU (Step S100). 

When judging that the current picture is a random access 
5 point (Y in Step S100), the picture coding apparatus 100 codes the 
sequence parameter set SPS (Step S102) and further codes each 
picture parameter set PPS for all the pictures in the random access 
unit RAU (Step S103). The picture coding apparatus 100 then 
places the coded sequence parameter set SPS and plural picture 

10 parameter sets PPS together at the head side of the random access 
unit RAU (Step S104). 

The picture coding apparatus 100 codes the current picture 
(Step S106) either after placing the sequence parameter set SPS 
and the picture parameter sets PPS in Step S104 or when it is 

15 judged that the current picture is not a random access point (N in 
Step S100). The picture coding apparatus 100 places the coded 
current picture after the sequence parameter set SPS and the 
picture parameter sets PPS mentioned above. Namely, when the 
parameter sets SPS, PPS mentioned above are arranged in Step 

20 S104, the picture coding apparatus 100 places the parameter sets 
SPS, PPS before any of the pictures pic in the random access unit 
RAU. When coding the current picture, the picture coding 
apparatus 100 places the parameter set identifier PSID indicating 
the picture parameter set PPS necessary for decoding the picture 

25 pic before the codeword for the pixels of the picture (i.e. pixel data 
pix) within the coded current picture (i.e. picture pic). 

After that, the picture coding apparatus 100 judges whether 
or not any uncoded pictures are found in the obtained image signal 
Vin (Step S108). When it is judged that an uncoded picture is 

30 found (Y in Step S108), the picture coding apparatus 100 operates 
repeatedly the operation starting from Step S100. When it is 
judged that no uncoded pictures are found, namely, when it is 
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judged that all the pictures are coded (N in Step S108), the picture 
coding apparatus 100 terminates the processing of coding. The 
stream Str is generated using the picture coding method as 
described above. 

5 Thus, in the picture coding method according to the present 

embodiment, the stream Str is generated in such a way that the 
sequence parameter set SPS and the picture parameter sets PPS 
necessary for decoding (coding) all the pictures included in the 
random access unit RAU are placed in the random access unit RAU. 

10 The picture decoding apparatus therefore can start decoding 
properly, namely, can start performing random access, by referring 
to the sequence parameter set SPS and the picture parameter sets 
PPS included in the head of the random access unit RAU in the 
obtained stream Str, even when the stream Str is obtained in the 

15 middle. The picture coding apparatus also does not need to shift 
a position of reading the data, from the head of the stream Str to 
the random access point, and thereby, can start performing 
random access swiftly by omitting the waiting time for the random 
access, even when random access is performed by reading the 

20 stream Str from the recording medium. 

In the picture coding method according to the present 
embodiment, the stream Str, in which the sequence parameter set 
SPS and the picture parameter sets PPS are included in each 
random access unit RAU, is generated, therefore, a stream whose 

25 bit amount is greater than that of the stream Str9 generated using 
the conventional picture coding method is generated. However, a 
header necessary for decoding is not placed per picture as in the 
conventional picture coding method according to the MPEG-2. 
Therefore, the coding efficiency can be further improved with the 

30 present picture coding method compared to the conventional 
picture coding method according to the MPEG-2. 

The picture coding apparatus 100 according to the present 
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embodiment may generate structure identification information 
indicating a structure of the stream Str. 

Fig. 7 is an illustration for explaining the information 
outputted from the picture coding apparatus 100. 

As shown in Fig. 7, the picture coding apparatus 100 
generates structure identification information sid as an attachment 
to the stream Str and outputs it. 

The structure identification information sid indicates that 
the sequence parameter set SPS and the picture parameter sets 
PPS are included in all the random access units RAU in the stream 
Str. That is to say that it is possible to perform random access 
from an arbitrary random access unit RAU in the stream Str. 

The picture decoding apparatus, having obtained the stream 
Str and the structure identification information sid, can understand 
easily that the obtained stream Str can be decoded from an 
arbitrary random access unit RAU based on the structure 
identification information sid and perform random access by the 
fact the picture decoding apparatus attaches such structure 
identification information sid to the stream Str and outputs it. 

The picture coding apparatus 100 may include the structure 
identification information sid in the stream Str and output it. 

Fig. 8 is a structural diagram showing a structure of the 
stream Str that includes the structure identification information 
sid. 

As shown in Fig. 8, the picture coding apparatus 100 
generates a stream Str in such a way that the structure 
identification information sid is placed between a synchronous 
signal sync and a parameter set PS. 

(Variation 1) 

The following describes the first variation of the picture 
coding apparatus according to the present embodiment described 
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above. 

The picture coding apparatus according to the first variation 
outputs a stream in which a placement of the picture parameter set 
PPS is different from the stream Str outputted by the picture 
5 coding apparatus 100 according to the present embodiment 
described above. 

Fig. 9 is a structural diagram showing a structure of the 
stream outputted by the picture coding apparatus according to the 
present variation. 

10 The picture coding apparatus according to the present 

variation outputs a stream Strl that includes sequentially from the 
head a synchronous signal sync, a parameter set PS and plural 
random access units RAUl. 

The random access unit RAUl includes sequentially from the 

15 head a synchronous signal sync, a sequence parameter set SPS, a 
picture parameter set PPS (PPS1) and two pictures picl, pic2 , a 
picture parameter set PPS (PPS2) and a picture pic3. 

The picture parameter set PPS1 that is necessary for 
decoding the two pictures picl and pic2 is referred to by these 

20 pictures in common. The picture parameter set PPS2 that is 
unnecessary for decoding the pictures pic 1 and pic2 is not referred 
to by these pictures. That is to say, the picture parameter set 
PPS2 that is necessary for decoding the picture pic3 is referred to 
by the picture pic3. 

25 The picture parameter set PPS2, being referred to by the 

picture pic3 but not by the pictures picl and pic2, does not need to 
be placed before the pictures picl and pic2. 

The picture parameter PPS1, being referred to by the 
pictures picl and pic2, is already placed immediately before the 

30 picture picl, therefore, does not need to be placed immediately 
before the picture pic2 again. 

Namely, the picture coding apparatus according to the 
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present variation generates a stream Strl so that the picture 
parameter set PPS referred to by a predetermined picture is placed 
immediately before the predetermined picture except for the case 
in which it is already placed. 

Fig. 10 is a flowchart showing the picture coding method 
employed by the picture coding apparatus according to the present 
variation. 

The picture coding apparatus firstly judges whether or not a 
current picture to be coded is a random access point, that is, the 
first picture in the random access unit RAU1 (Step S200). 

When judging that the current picture is a random access 
point (Y in Step S200), the picture coding apparatus codes a 
sequence parameter set SPS (Step S202) and places it at the head 
side of the random access unit RAU1 (Step S203). The picture 
coding apparatus further codes a picture parameter set PPS of the 
current picture (Step S204) and places it after the sequence 
parameter set SPS in the random access unit RAU1 (Step S205). 

When judging that the current picture is not a random 
access point (N in Step S200), the picture coding apparatus further 
judges whether or not the picture parameter set PPS of the current 
picture is already coded and is placed after the random access 
point (Step S206). 

When judging in Step S206 that the picture parameter set 
PPS of the current picture is not coded (N in Step S206), the picture 
coding apparatus codes the picture parameter set PPS of the 
current picture and places it (Steps S204 and S205). 

Either after the placement of the picture parameter set PPS 
of the current picture performed in Step S205 or when it is judged 
in Step 206 that the picture parameter set PPS of the current 
picture is already coded (Y in Step S206), the picture coding 
apparatus codes the current picture (Step S208). The picture 
coding apparatus places the coded current picture (i.e. picture pic) 
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immediately after the corresponding picture parameter set PPS 
when coding the current picture after the placement of the picture 
parameter set PPS performed in Step S205. Namely, the picture 
coding apparatus 100 places the picture parameter set PPS 
immediately before the coded current picture (i.e. picture pic) in 
the random access unit RAU in the placement of the picture 
parameter set PPS performed in Step S205. When coding the 
current picture, the picture coding apparatus places a parameter 
set identifier PSID, which indicates a picture parameter set 
necessary for decoding the picture pic, before the codeword for the 
pixels of the picture (i.e. pixel data pix) in the coded current 
picture (i.e. picture pic). 

Then, the picture coding apparatus judges whether or not 
any uncoded pictures are found in the obtained image signal Vin 
(Step S210). When it is judged that an uncoded picture is found 
(Y in Step S210), the picture coding apparatus executes repeatedly 
the operation starting from Step S200, and when it is judged that 
no uncoded pictures are found which means that all the pictures 
are coded (N in Step S210), the picture coding apparatus 
terminates the coding processing. The stream Strl is generated 
using the picture coding method as described above. 

Under the picture coding method employed by the picture 
coding apparatus 100 described above, since it is after the 
determination, per random access unit RAU, of all the picture 
parameter sets PPS necessary for decoding each picture that these 
picture parameter sets PPS are coded in a group and placed in the 
head of the random access unit RAU, it is necessary to temporarily 
store the determined plural picture parameters PPS. 

In contrast, under the picture coding method according to 
the present variation, since the picture parameter sets PPS 
necessary for decoding the pictures are sequentially determined 
per random access unit RAU1 and the picture parameter sets PPS 
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are coded and then placed in a random access unit, it is not 
necessary to store the picture parameter sets PPS as mentioned 
above. Therefore, the structure of the picture coding apparatus 
according to the present variation can be more simplified than that 
of the picture coding apparatus 100. 

In the present embodiment and variation, the sequence 
parameter set SPS can be modified using a unit superior to the 
random access unit RAU, therefore, it is enough to place the 
random access unit RAU for one time. 

(Variation 2) 

The following describes the second variation of the picture 
coding apparatus according to the present embodiment. 

The picture coding apparatus according to the second 
variation outputs a stream in which a placement of the sequence 
parameter set SPS is different from the placement in the stream 
outputted by the picture coding apparatus 100 according to the 
present embodiment described above. 

Fig. 11 is a structural diagram showing a structure of the 
stream outputted by the picture coding apparatus according to the 

present variation. 

The picture coding apparatus according to the present 
variation outputs a stream Str2 that includes sequentially from the 
head a synchronous signal sync, a parameter set PS and plural 
random access unit groups GRAU. 

The random access unit group GRAU includes sequentially 
from the head a sequence parameter set SPS and plural random 
access units RAU 2. Namely, the random access unit group GRAU 
is constructed as a unit assembling plural random access units 
RAU2 for the convenience of storage and transmission. 

The sequence parameter set SPS is a parameter which can 
be modified using a unit superior to the random access unit RAU2. 
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Therefore, the modification does not necessarily need to be made 
for each random access unit RAU2. Normally, only several 
sequence parameter sets SPS are required in the stream, and in 
many cases, only one sequence parameter set is enough. 

The picture coding apparatus according to the present 
variation does not place a sequence parameter set SPS for each 
random access unit RAU2, but for each random access unit group 
GRAU, that is, to place a single sequence parameter set SPS in the 
head of each random access unit group GRAU. 

The random access unit group GRAU includes a sequence 
parameter set SPS and a picture parameter set PPS which are 
necessary for decoding all the pictures included in it, therefore, the 
random access unit group GRAU is identifiable as the random 
access unit RAU or RAU1 according to the embodiment and the 
variation 1 described above. The RAU 2 included in such random 
access unit group GRAU can be regarded as a subunit obtained by 
dividing the random access unit group GRAU. 

Fig. 12 is a flowchart showing an operation of the picture 
coding apparatus according to the present variation. 

The picture coding apparatus firstly judges whether or not a 
current picture to be coded is the first picture included in the 
random access unit group GRAU (Step S300). 

When judging that the current picture is the first picture (Y 
in Step S300), the picture coding apparatus codes a sequence 
parameter set SPS (Step S302) and places it at the head side of the 
random access unit group GRAU (Step S303). The picture coding 
apparatus further codes the picture parameter set PPS of the 
current picture (Step S304) and places it at the head side of the 
random access unit RAU 2 (Step S305). 
30 When judging that the current picture is not the first picture 

included in the random access unit group GRAU (N in Step S300), 
the picture coding apparatus further judges whether or not the 



20 



25 
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picture parameter set PPS of the current picture is already coded 
and is placed after the random access point (i.e., a head of the 
random access unit RAU2) (Step S306). 

When it is judged in Step S306 that the picture parameter 
set PPS of the current picture is not coded (N in Step S306), the 
picture coding apparatus codes the picture parameter set PPS of 
the current picture and places it (Steps S304 and S305). 

Either after the placement of the picture parameter set PPS 
performed in Step S305 or when judging in Step S306 that the 
picture parameter set PPS of the current picture is already coded 
(N in Step S 306), the picture coding apparatus codes the current 

picture (Step S308). 

The picture coding apparatus then judges whether or not 
any uncoded pictures are found in the obtained image signal Vin 
(Step S310). When judging that an uncoded picture is found (Y in 
Step S310), the picture coding apparatus executes repeatedly the 
operation starting from Step S300. When judging that no 
uncoded pictures are found (N in Step S310), the picture coding 
apparatus terminates the coding processing. The stream Str2 in 
which only one sequence parameter set SPS is included in each 
random access unit group GR.AU is generated using the picture 
coding method described above. 

Thus, the picture coding apparatus according to the present 
variation generates the stream Str2 in which a single sequence 
parameter set SPS is placed for plural random access units RAU2. 
The bit amount included in the stream Str2 therefore can be 
reduced more than the bit amount included in the stream Str 
generated by the picture coding apparatus 100 described above. 

In the variations 1 and 2 described in the present 
embodiment, a coded parameter set PS (i.e. PPSs and SPSs) is 
placed at the head side of the stream, however, it may not be 
placed as such since it is placed, as necessary, in each random 
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access unit RAU. 



(Variation 3) 

The following describes the third variation of the picture 
5 coding apparatus according to the present embodiment described 
above. 

The picture coding apparatus according to the third variation 
generates and outputs a stream different from the stream 
outputted by the picture coding apparatus 100 according to the 
10 present embodiment described above. 

Fig. 13 is a structural diagram showing a structure of the 
stream outputted by the picture coding apparatus according to the 

present variation. 

The picture coding apparatus according to the present 
15 variation outputs a stream Str3 that includes sequentially from the 

head a synchronous signal sync and plural random access units 

RAU (RAUO, RAU01, RAU02, ... ). 

The random access unit RAU01 includes sequentially from 

the head a synchronous signal sync, a parameter set PS (PS1), 
20 pictures picl, pic2 and pic3. The random access unit RAU2 

includes sequentially from the head a synchronous signal sync, 

random access point information RPS, a parameter set PS (PS2), 

pictures pic4, pic5 and pic6. 

For example, the picture picl is an I-picture that is 
25 intra-picture coded whereas the picture pic2 is a P-picture that is 

coded with reference to the picture picl. The picture pic3 is a 

B-picture that is coded with reference to the pictures picl and pic2. 

The picture pic4 is an I-picture that is intra-picture coded whereas 

the picture pic5 is a B-picture that is coded with reference to the 
30 pictures pic2 and pic4. The picture pic6 is a B-picture that is 

coded with reference to the picture pic4 and other pictures in the 

random access unit RAU02. 
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The parameter set PS1 includes a sequence parameter set, 
picture parameter sets for the pictures pic2 and pic3 and a picture 
parameter set for the picture pic5 that is included in the random 

access unit RAU02. 

Namely, the picture pic2 is decoded with reference to the 
parameter set PS1 and the picture picl whereas the picture pic3 is 
decoded with reference to the parameter set PS1 and the pictures 
picl and pic2, when random access is performed on the stream 
Str3 starting from the random access unit RAU01. Then, the 
picture pic5 included in the random access unit RAU02 is decoded 
with reference to the parameter set PS1 and the pictures pic2 and 
pic4 whereas the picture pic6 is decoded with reference to the 
parameter set PS2, the picture pic4 and other pictures included in 
the random access unit RAU02. 

When random access is performed on the stream Str3 
starting from the random access unit RAU02, the picture pic5 is 
neither decoded nor displayed whereas the pictures pic4 and pic6 
are sequentially decoded and then displayed. 

Namely, there is no need to place the picture parameter set 
necessary for the picture pic5 in the random access unit RAU02 
since the decoding of the picture pic5, a B-picture, included in the 
random access unit RAU02 needs to refer to the pictures included 
in the previous random access unit RAU01. Even when random 
access is performed on the stream Str3 starting from the random 
access unit RAU02, the picture pic5 is not decoded. Therefore, 
there is no need to place, in the random access unit RAU02, the 
picture parameter set necessary for the picture pic5, as described 
above. 

In the variations 1-3 of the present embodiment described 
above, a parameter set identifier PSID is included in the stream on 
a picture-by-picture basis. However, when the picture is 
composed of plural slices, a parameter set identifier PSID may be 
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included on a slice-by-slice basis. 

The random access unit shown in the embodiment and the 
variations 1-3 described above does not necessarily have to be a 
group of pictures including a picture of the special type defined by 
the JVT. It may be a group of pictures including simply an 
intra-picture coded picture (I-picture) in the head because of the 
fact that a parameter set PS is placed for each random access unit 

RAU as necessary. 

Furthermore, in the embodiment and the variations 1-3 
described above, a single sequence parameter set SPS and plural 
picture parameter sets PPS that are different from one another are 
coded for one time and placed for each random access unit RAU or 
each random access unit group GRAU. By performing coding on 
these parameter sets for plural times, however, a plurality of the 
same coded sequence parameter sets SPS and a plurality of the 
same coded picture parameter sets PPS may be placed for each 
random access unit RAU or each random access unit group GRAU. 
Consequently, errors can be prevented, for example, at the time of 
decoding. 

(Second Embodiment) 

Furthermore, the processing illustrated in the above 
embodiment can be carried out easily in an independent computer 
system by recording a program for realizing the picture coding 
method described in the above embodiment onto a recording 
medium such as a flexible disk or the like. 

Figs 14A, 14B and 14C are illustrations of a recording 
medium, on which a program for carrying out the picture coding 
method described in the first embodiment in the computer system 
is recorded. 

Fig. 14B shows a full appearance of a flexible disk FD, its 
structure at cross section and a full appearance of the disk itself 



-30- 



FD1 as a main body of a recording medium whereas Fig. 14A shows 
an example of a physical format of the flexible disk FD1. 

The disk FD1 is contained in a case F with a plurality of tracks 
Tr formed concentrically from the periphery to the inside on the 
5 surface of the disk FD1, and each track is divided into 16 sectors Se 
in the angular direction. Thus, the picture coding method as the 
program mentioned above is recorded in an area assigned for it on 
the disk FD1. 

Fig. 14C shows a structure for recording and reading out the 

10 program on the flexible disk FD. 

When the program is recorded on the flexible disk FD, the 
computer system Cs writes in the picture coding method as the 
program mentioned above via a flexible disk drive FDD. When the 
picture coding method is constructed in the computer system Cs 

15 using the program on the flexible disk FD, the program is read out 
from the flexible disk FD and then transferred to the computer 
system Cs by the flexible disk drive FDD. 

In the above explanation, the flexible disk FD is used as an 
example of a recording medium, but the same processing can also 

20 be performed using an optical disk. In addition, the recording 
medium is not limited to these mentioned above, but any other 
medium capable of recording a program such as an IC card and a 
ROM cassette can be employed. 

25 (Third Embodiment) 

The following is a description for the application of the 
picture coding method illustrated in the above-mentioned 
embodiment and a system using the method. 

Fig. 15 is a block diagram showing an overall configuration of 
30 a content supply system exlOO for realizing content delivery 
service. The area for providing communication service is divided 
into cells of desired size, and cell sites exl07-exll0, which are 
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fixed wireless stations, are placed in respective cells. 

This content supply system exlOO is connected to 
apparatuses such as a computer exlll, a Personal Digital 
Assistant (PDA) exll2, a camera exll3, a cell phone exll4 and a 
cell phone with a camera exll5 via, for example, Internet exlOl, 
an Internet service provider exl02, a telephone network exl04, as 
well as the cell sites exl07-exll0. 

However, the content supply system exlOO is not limited to 
the configuration shown in Fig. 15 and may be connected to a 
combination of any of them. Also, each apparatus may be 
connected directly to the telephone network exl04, not through 
the cell sites exl07-exll0. 

The camera exll3 is an apparatus capable of shooting video 
such as a digital video camera. The cell phone exll4 may be a cell 
phone of any of the following system: a Personal Digital 
Communications (PDC) system, a Code Division Multiple Access 
(CDMA) system, a Wideband-Code Division Multiple Access 
(W-CDMA) system or a Global System for Mobile Communications 
(GSM) system, a Personal Handyphone System (PHS) or the like. 

A streaming server exl03 is connected to the camera exll3 
via the telephone network exl04 and also the cell site exl09, 
which realizes a live distribution or the like using the camera exll3 
based on the coded data transmitted from the user. Either of the 
camera exll3, the server which transmits the data and the like 
may code the data. The moving picture data shot by a camera 
exll6 may be transmitted to the streaming server exl03 via the 
computer exlll. In this case, either the camera exll6 or the 
computer exlll may code the moving picture data. An LSI exll7 
included in the computer exlll and the camera exll6 performs 
the coding processing. Software for coding and decoding pictures 
may be integrated into any type of recording medium (such as a 
CD-ROM, a flexible disk and a hard disk) that is a recording 
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medium which is readable by the computer exlll or the like. 
Furthermore, a cell phone with a camera exll5 may transmit the 
moving picture data. This moving picture data is the data coded 
by the LSI included in the cell phone exll5. 

The content supply system exlOO codes contents (such as a 
music live video) shot by a user using the camera exll3, the 
camera exll6 or the like in the same way as shown in the 
above-mentioned embodiment and transmits them to the 
streaming server exl03, while the streaming server exl03 makes 
stream delivery of the content data to the clients at their requests. 
The clients include the computer exlll, the PDA exll2, the 
camera exll3, the cell phone exll4 and so on capable of decoding 
the above-mentioned coded data. In the content supply system 
exlOO, the clients can thus receive and reproduce the coded data, 
and can further receive, decode and reproduce the data in real time 
so as to realize personal broadcasting. 

When each apparatus in this system performs coding or 
decoding, the picture coding apparatus or the picture decoding 
apparatus shown in the above-mentioned embodiment can be 
used. 

A cell phone will be explained as an example of such 
apparatus. 

Fig. 16 is a diagram showing the cell phone exll5 using the 
picture coding method explained in the above-mentioned 
embodiment. The cell phone exll5 has an antenna ex201 for 
communicating with the cell site exllO via radio waves, a camera 
unit ex203 such as a CCD camera capable of shooting moving and 
still pictures, a display unit ex202 such as a liquid crystal display 
for displaying the data such as decoded pictures and the like shot 
by the camera unit ex203 or received by the antenna ex201, a body 
unit including a set of operation keys ex204, a voice output unit 
ex208 such as a speaker for outputting voice, a voice input unit 
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ex205 such as a microphone for inputting voice, a recording 
medium ex207 for recording coded or decoded data such as data of 
moving or still pictures shot by the camera, data of received 
e-mails and that of moving or still pictures, and a slot unit ex206 
for attaching the recording medium ex207 to the cell phone exll5. 
The recording medium ex207 stores in itself a flash memory 
element, a kind of Electrically Erasable and Programmable Read 
Only Memory (EEPROM) that is a nonvolatile memory electrically 
erasable from and rewritable to a plastic case such as an SD card. 

Next, the cell phone exll5 will be explained with reference 
to Fig. 17. In the cell phone exll5, a main control unit ex311, 
designed in order to control overall each unit of the main body 
which contains the display unit ex202 as well as the operation keys 
ex204, is connected mutually to a power supply circuit unit ex310, 
an operation input control unit ex304, a picture coding unit ex312, 
a camera interface unit ex303, a Liquid Crystal Display (LCD) 
control unit ex302, a picture decoding unit ex309, a 
multiplexing/demultiplexing unit ex308, a read/write unit ex307, a 
modem circuit unit ex306 and a voice processing unit ex305 via a 
synchronous bus ex313. 

When a call-end key or a power key is turned ON by a user's 
operation, the power supply circuit unit ex310 supplies the 
respective units with power from a battery pack so as to activate 
the digital cell phone with a camera exll5 as a ready state. 

In the cell phone exll5, the voice processing unit ex305 
converts the voice signals received by the voice input unit ex205 in 
conversation mode into digital voice data under the control of the 
main control unit ex311 including a CPU, ROM and RAM, the modem 
circuit unit ex306 performs spread spectrum processing for the 
digital voice data, and the communication circuit unit ex301 
performs digital-to-analog conversion and frequency conversion 
for the data, so as to transmit it via the antenna ex201. Also, in 
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the cell phone exll5, the communication circuit unit ex301 
amplifies the data received by the antenna ex201 in conversation 
mode and performs frequency conversion and the analog-to-digital 
conversion to the data, the modem circuit unit ex306 performs 
5 inverse spread spectrum processing of the data, and the voice 
processing unit ex305 converts it into analog voice data so as to 
output it via the voice output unit ex208. 

Furthermore, when transmitting an e-mail in data 
communication mode, the text data of the e-mail inputted by 

10 operating the operation keys ex204 of the main body is sent out to 
the main control unit ex311 via the operation input control unit 
ex304. In the main control unit ex311, after the modem circuit 
unit ex306 performs spread spectrum processing of the text data 
and the communication circuit unit ex301 performs the 

15 digital-to-analog conversion and the frequency conversion for the 
text data, the data is transmitted to the cell site exllO via the 
antenna ex201. 

When picture data is transmitted in data communication 
mode, the picture data shot by the camera unit ex203 is supplied to 

20 the picture coding unit ex312 via the camera interface unit ex303. 
When it is not transmitted, it is also possible to display the picture 
data shot by the camera unit ex203 directly on the display unit 
ex202 via the camera interface unit ex303 and the LCD control unit 
ex302. 

25 The picture coding unit ex312, which includes the picture 

coding apparatus as described for the present invention, 
compresses and codes the picture data supplied from the camera 
unit ex203 using the coding method employed by the picture 
coding apparatus as shown in the embodiment mentioned above so 

30 as to transform it into coded image data, and sends it out to the 
multiplexing/demultiplexing unit ex308. At this time, the cell 
phone exll5 sends out the voice received by the voice input unit 
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ex205 during the shooting with the camera unit ex203 to the 
multiplexing/demultiplexing unit ex308 as digital voice data via 
the voice processing unit ex305. 

The multiplexing/demultiplexing unit ex308 multiplexes the 
5 coded image data supplied from the picture coding unit ex312 and 
the voice data supplied from the voice processing unit ex305, using 
a predetermined method, then the modem circuit unit ex306 
performs spread spectrum processing of the multiplexed data 
obtained as a result of the multiplexing, and lastly the 

10 communication circuit unit ex301 performs digital-to-analog 
conversion and frequency transform of the data for the 
transmission via the antenna ex201. 

As for receiving data of a moving picture file which is linked 
to a Web page or the like in data communication mode, the modem 

15 circuit unit ex306 performs inverse spread spectrum processing for 
the data received from the cell site exllO via the antenna ex201, 
and sends out the multiplexed data obtained as a result of the 
inverse spread spectrum processing. 

In order to decode the multiplexed data received via the 

20 antenna ex201, the multiplexing/demultiplexing unit ex308 
demultiplexes the multiplexed data into a bit stream of image data 
and that of voice data, and supplies the coded image data to the 
picture decoding unit ex309 and the voice data to the voice 
processing unit ex305, respectively via the synchronous bus 

25 ex313. 

Next, the picture decoding unit ex309, including the picture 
decoding apparatus as described for the present invention, 
decodes the bit stream of the image data using the decoding 
method corresponding to the coding method as shown in the 
30 above-mentioned embodiments to generate reproduced moving 
picture data, and supplies this data to the display unit ex202 via 
the LCD control unit ex302, and thus the image data included in the 
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moving picture file linked to a Web page, for instance, is displayed. 
At the same time, the voice processing unit ex305 converts the 
voice data into analog voice data, and supplies this data to the 
voice output unit ex208, and thus the voice data included in the 
5 moving picture file linked to a Web page, for instance, is 
reproduced. 

The present invention is not limited to the above-mentioned 
system since ground-based or satellite digital broadcasting has 
been in the news lately and at least either the picture coding 

10 apparatus or the picture decoding apparatus described in the 
above-mentioned embodiment can be incorporated into a digital 
broadcasting system as shown in Fig. 18. More specifically, a bit 
stream of video information is transmitted from a broadcast station 
ex409 to or communicated with a broadcast satellite ex410 via 

15 radio waves. Upon receipt of it, the broadcast satellite ex410 
transmits radio waves for broadcasting. Then, a home-use antenna 
ex406 with a satellite broadcast reception function receives the 
radio waves, and a television (receiver) ex401 or a set top box 
(STB) ex407 decodes a coded bit stream for reproduction. The 

20 picture decoding apparatus as shown in the above-mentioned 
embodiment can be implemented in the reproducing apparatus 
ex403 for reading out and decoding the bit stream recorded on a 
recording medium ex402 such as a CD and a DVD. In this case, 
the reproduced moving picture signals are displayed on a monitor 

25 ex404. It is also conceivable to implement the picture decoding 
apparatus in the set top box ex407 connected to a cable ex405 for 
a cable television or the antenna ex406 for satellite and/or 
ground-based broadcasting so as to reproduce them on a monitor 
ex408 of the television ex401. The picture decoding apparatus 

30 may be incorporated into the television, not in the set top box. 
Also, a car ex412 having an antenna ex411 can receive signals 
from the satellite ex410 or the cell site exl07 for replaying moving 
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picture on a display device such as a car navigation system ex413 
set in the car ex412. 

Furthermore, the picture coding apparatus as shown in the 
above-mentioned embodiment can code picture signals and record 
5 them on the recording medium. As a concrete example, a 
recorder ex420 such as a DVD recorder for recording picture 
signals on a DVD disk ex421, a disk recorder for recording them on 
a hard disk can be cited. They can be recorded on an SD card 
ex422. When the recorder ex420 includes the picture decoding 

10 apparatus as shown in the above-mentioned embodiment, the 
picture signals recorded on the DVD disk ex421 or the SD card 
ex422 can be reproduced for display on the monitor ex408. 

As for the structure of the car navigation system ex413, the 
structure without the camera unit ex203, the camera interface unit 

15 ex303 and the picture coding unit ex312, out of the components 
shown in Fig. 17, is conceivable. The same applies for the 
computer exlll, the television (receiver) ex401 and others. 

In addition, three types of implementations can be 
conceived for a terminal such as the cell phone exll4: a 

20 sending/receiving terminal implemented with both an encoder and 
a decoder, a sending terminal implemented with an encoder only, 
and a receiving terminal implemented with a decoder only. 

As described above, it is possible to use the picture coding 
method described in the above-mentioned embodiment for any of 

25 the above-mentioned apparatuses and systems, and by thus doing, 
the effects described in the above-mentioned embodiment can be 
obtained. 

From the invention thus described, it will be obvious that the 
embodiments of the invention may be varied in many ways. Such 
30 variations are not to be regarded as a departure from the spirit and 
scope of the invention, and all such modifications as would be 
obvious to one skilled in the art are intended for inclusion within 
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the scope of the following claims. 



Industrial Applicability 

The picture coding method according to the present 
invention allows coding of pictures so that random access can be 
performed without reducing the coding efficiency. The present 
picture coding method can be employed by a picture coding 
apparatus, such as a video camera, a cell phone with a recording 
function, or the like, which codes pictures using the method. 
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